f UNIVERSITY OF 
LIVERPOOL 



PHYS393 - Statistical Physics 

Part 2: Two Examples of the Boltzmann 

Distribution 



The Boltzmann distribution 



In the previous part of this course, we derived the Boltzmann 
distribution: 

N _5± 

riA = — e kr (1) 
Z 

where nj is the number of particles in the energy state with 
energy ej, k is Boltzmann's constant, T is the thermodynamic 
temperature, N is the total number of particles, and Z is the 
partition function: 

^ = £e-3\ (2) 
3 

The temperature is a parameter in the distribution, such that 
the total energy is equal to a specified value, U: 

£ n 3 £ 3 = U - ( 3 ) 
3 
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The Boltzmann distribution 



In this part of the lecture course, we shall see what we can 
learn by applying the Boltzmann distribution to two example 
systems. These systems are: 

• A collection of spin-i particles in a magnetic field. 

• A collection of 1-dimensional harmonic oscillators. 

We will look in particular at properties that can be measured in 
the laboratory, such as the specific heat capacity and its 
variation with temperature. 



Statistical Physics 2 Part 2: Boltzmann Distbn. Examples 



Example 1: Spin-^ solid 



As the first example, we will consider a spin-^ solid. This 
consists of a large number of particles (atoms), each of which 
has a fixed position in space. Each particle has a magnetic 
moment that can be aligned either parallel or anti-parallel with 
an external magnetic field. 

We shall assume that the magnetic moment of one particle 
interacts only weakly with those around it. This means that 
the energy states of each particle are essentially those of an 
isolated particle; but that particles can exchange energy, so as 
to achieve an equilibrium distribution of energies. 
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Example 1: Spin-^ solid 



Let us denote the energy levels: 
e\ : spin parallel to external field; 
£2 '■ spin anti-parallel to external field. 

We also define the energy difference Ae between the energy 
levels: 





Ac = £ 2 


- £1- 




> B 


Energy 




s 2 = ^B 




• 


O 




-juB 







(4) 



As = 2juB 
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Example 1: Spin-^ solid - populations 



Let us begin by finding the populations of each energy level at 
a given temperature, T. The partition function Z is given by: 

£j £2 

Z = ^e~kT = e~kT + e~kT. (5) 
3 

Hence, from the Boltzmann distribution (1), the populations n± 
and n2 of energy levels e\ and £2 are: 



_ £1 

_ Ne kT 



N 



Ae 



(6) 



e k T -\- e kT 1 _|_ e fcT 



and: 



_ £2. 

^2 ^2 



Ae 

A£ 



(7) 



Note that ni + n 2 
system. 



e fcT -|- e fcT 1 _|_ e fcr 
AT, the total number of particles in the 
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Spin-^ solid: energy level populations 




Statistical Physics 



Part 2: Boltzmann Distbn. Examples 



Spin-i solid: energy level populations 



It is worth noting the populations in the limit of low and high 
temperature. The populations are given by: 



N 



ni = 



Ae ' 
1 + e kT 



n 2 = 



As 

Ne kT 

As 

1 + e kT 



(8) 



We see that in the low-temperature limit, T —> 0: 

ni A/", n 2 -> 0. (9) 
In other words, all the particles occupy the lowest energy level. 



In the high-temperature limit, T — > oo: 

ni -> — , n 2 — • (10) 

In other words, half the particles occupy the lowest energy 
level, and half occupy the highest energy level. 
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Spin-Jj solid: total energy 



Now let us consider how the total energy of the system varies 
with temperature. The total energy U is given by: 



u = J2 n j £ j = 



N ( e\ + e 2 e irj 
1 + e kT 



(11) 



Again, we can find the low-temperature limit: 

U ^ Ne 1 as T^O, 
and the high-temperature limit: 

U -► -iV (£i + £ 2 ) as T^oo. 



(12) 



(13) 
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Spin-i solid: total energy 
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Spin-j solid: heat capacity 



The heat capacity at constant volume Cy is defined by: 

'dU\ 
.dTJv 



C V = 



(14) 



Note that in many systems, the energy levels depend on the 
volume of the system, so it is necessary to impose the condition 
of constant volume. This is not the case for the present system 
of spin-^ particles in a magnetic field; nonetheless, we shall 
assume that the volume of the system remains constant. 



To find the heat capacity, we use the expression for the total 
energy (11): 



U = 



N (ex + e 2 e fer J 



Ae 

1 + e kT 



and take the derivative with respect to T: 



C V = 



dU 
dTJv 



= N 



Ae 
e kT 



kT 2 /„ , _Ae\ 2 
1 + e kT 



(15) 



(16) 
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Spin-^ solid: heat capacity 
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Spin-j solid: heat capacity 



Again, we can take the limits of high and low temperature. 
The high temperature case is straightforward, and we find: 

Ae z e kT N/\e z , x 

C V = N y =- as T^oo. (17) 

1 + e fcT j 



To find the low temperature limit, we define x = Ae/kT, in 
terms of which we write: 

rp 2 p X 

C v = Nk— — 9 . (18) 

(1 + e-* ) 2 

Since x 2 /e :r — > 0 as x — »• oo (T — > 0), we find that: 

Cy^O as T^O. (19) 
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Spin-^ solid: entropy 



Next let us look at how the entropy of the system changes with 
temperature. Here, we make use of the Helmholtz free energy: 

F = U -TS, (20) 

to write: 

dF = dU -TdS - SdT. (21) 
From the first law of thermodynamics: 

dU = TdS -pdV, (22) 

so: 

dF = -pdV-SdT. (23) 

Hence, we find that: 

S = -(IP\ . (24) 
\dTJv 
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Spin-^ solid: entropy 



Now we use the relation between the Helmholtz free energy and 
the partition function: 



F = -NkT\nZ. 
Using equation (5) for the partition function, we find: 

F = -NkT\n 



= -NkT 



e kr I 1 -f e kT J 



— + In fl + ) 



= - TV/cTIn ^1 + e'T^j 



(25) 

(26) 
(27) 
(28) 



Taking the derivative with respect to temperature T, we find: 

(29) 



S = 



dF\ ( Ae\ (e/kT)e~^r 

J = Nk\n [1 + e-kT) + Nk y ' ) 



dTJv 



1 + e kT j 
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Spin-^ solid: entropy 
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Spin-^ solid: entropy 



As usual, we look for the low-temperature and the 
high-temperature limits. We find that: 

S 0 as T 0. (30) 

This is consistent with Boltzmann's equation, since at zero 
temperature, all particles are in the lowest energy state, and 
there is only one microstate accessible to the system, i.e. 
Q = 1. Hence, from Boltzmann's equation: 



S = k\nn, (31) 



we find S = 0. 
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Spin-^ solid: entropy 



In the high temperature limit, we find from equation (29): 

Ae 

/ Ae\ (e/kT)e kr 
S = Nk In 1 + e'kT + Nky- -^r- (32) 

V J (l + e~feTj 

that: 

S^Nk\n2 as T^oo. (33) 

This is also consistent with Boltzmann's equation. At very high 
temperature, half the particles are in the lower energy state, 
and half are in the higher energy state. Since each of the TV 
particles can be in one of two states with equal probability, the 
number of microstates accessible to the system is Q = 2 N . 
Hence: 

S = fclnQ = k\n2 N = Nk\n2. (34) 
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Spin-^ solid: magnetisation 



Finally, we consider the magnetisation of the system. The 
magnetisation M is defined as the magnetic moment induced in 
the solid by an external field B. Since n\ particles are in the 
low energy state, with spin parallel to B, and ri2 are in the high 
energy state with spin antiparallel to B, the magnetisation of 
the system is: 

M — nijtt — ri2/i- (35) 

Using the population equations (6) and (6) with ei = -fiB and 
e 2 = +11B leads to: 



M = N/J, ^ 



( e kT - e kT 



fj,B \ ' 



{ekT + e kT J 



(36) 



which can be written as: 



M = 7V/xtanh ( 



liB 



(37) 
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Spin-i solid: magnetisation 




0.5 1 



1.5 2, 2.5 

fiB/kT 



3.5 



Note the horizontal axis is fxB/kT: inversely proportional to T! 
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Spin-i solid: magnetisation 



At low temperatures, kT <c nB, we have: 

M = A^/xtanh (^Pj « jV/x. (38) 

Nearly all particles are in the lower energy state, parallel to the 
magnetic field, and the magnetisation is "saturated". In this 
condition, the magnetisation becomes independent of field 
strength and temperature. 



At high temperatures, kT > fiB, then: 

u 2 B , N 

M « N— — . (39) 
kT v } 

In this state, the magnetisation varies in proportion to the field 

strength, and in inverse proportion to the temperature. 

Equation (39) expresses Curie's law for a spin-^ paramagnetic 
material. The theory for solids having higher spin is similar, but 
more complicated. 
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Example 2: TV localised one-dimensional harmonic oscillators 



We briefly discussed the quantum harmonic oscillator when 
introducing the principles of statistical mechanics in Part 1 of 
this course. We shall now consider a collection of a large 
number N of quantum harmonic oscillators. We shall aim to 
calculate the energy, heat capacity and entropy of this system 
as functions of temperature. 

Although this system may at first appear artificial, it may be 
used as a very simple model of a solid, in which the particles 
are able to oscillate about fixed positions. If there are TV 
particles in the solid, each able to oscillate in three dimensions, 
then the solid may be treated as a collection of 37V 
one-dimensional oscillators. 

We shall first derive some results, then discuss the successes 
and failures of this system as a model for a solid. 
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Example 2: TV localised one-dimensional harmonic oscillators 



Recall (from courses on quantum mechanics) that the allowed 
energy levels in a quantum harmonic oscillator are given by: 

£j = (\ + j)hw, (40) 

where j = 0, 1,2,3... is zero or a positive integer, and w is the 
characteristic frequency of the system (which is related to the 
mass of the particle and the potential energy), h is Planck's 
constant divided by 27r. 

We shall consider a (large) number TV of such oscillators. As 
usual, we shall assume that the interactions between the 
oscillators are weak, so they can exchange energy and reach an 
equilibrium distribution, but have essentially the same energy 
levels as isolated oscillators. 
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Example 2: TV localised one-dimensional harmonic oscillators 

We shall aim to calculate the total energy of the system, the 
heat capacity, and the entropy as functions of temperature. 

We begin with the total energy, U. There are two ways to 
calculate U. We can either sum the energy levels weighted by 
the populations (given by the Boltzmann distribution): 

N _f± 

U = Y. n j £ jl n 3 = -r^ e ( 41 ) 

3 

Or, we can use the relation: 

dln(Z) 1 , N 

U = N — , (3 = . (42) 

d(3 kT v J 

Either way, we need the partition function, Z\ 

Z = ^e~fcr. (43) 
3 

Statistical Physics 23 Part 2: Boltzmann Distbn. Examples 



N harmonic oscillators: energy 



Let's calculate the total energy U using both methods, and 
compare the results. 

First, we need to evaluate the partition function, Z: 



z = E« _3, = E«p(-^ + j)I). < 44 ) 

3 3 

where we have defined the parameter 0 (with units of 
temperature) such that: 

kO = hw. (45) 



The right hand side is a geometric progression, which we can 
evaluate: 

_e_ 
e 2T 

Z = (46) 
1 - e t 
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N harmonic oscillators: energy 



Now we use the expression for the energy ej = (| + j)hu in 
equation (41) for the total energy U, to find: 

y = f?(i+') fc ' exp (-(i +j ')l)- (47) 

The right hand side can be expressed as the sum of two 
geometric progressions. We find: 



N 0 
U = —k9e~^r 

Z 



2 1 -e~T 



+ 



e t 



e \ 2 
1 - e~T j 



(48) 



Finally, substituting in expression (46) for the partition function 
Z, we obtain: 



U = NkO 



[eT - 1 



(49) 
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N harmonic oscillators: energy 



We can check this result by using the second of the two 
formulae for the total energy, U, equation (42): 

J\n(Z) „ 1 



U = N- 



(3 = 



d/3 kT 
We write the partition function (46) in the form: 



Z = 



e \k6f3 



1 _ e fc0/3' 

and take the logarithm: 

ln(Z) = hsOp - In (l - e k9(3 ) . 

Taking the derivative with respect to (3: 

dln(Z) 1 kOe^f 5 
d/3 2 (l - e ke $) 

1 n kO 

= k6+ , r- 

2 ^ _ l) 



(50) 
(51) 

(52) 
(53) 
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N harmonic oscillators: energy 



So we find, having started from equation (42): 



U = Nk0 



[eT - 1 



This is in agreement with the expression we found for the total 
energy U (49), starting from (41). 
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N harmonic oscillators: energy 
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1 
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N harmonic oscillators: energy 



Let us look at the low temperature and high temperature limits 
of the total energy (49): 



U = Nk6 



1 1 

2 + 



eT - 1 



We see that: 



and: 



U^-NkO as T^O (T<0). 



U ^ NkT as T^oo (T»0). 



(54) 



(55) 
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N harmonic oscillators: heat capacity 



Now we proceed to find the heat capacity, Cy. Recall that this 
is simply the derivative of the total energy U with respect to 
temperature T, at constant volume V: 

'dU\ 



<* = (I) 



v 



Using equation (49) for the energy: 



we find: 



U = Nkd 



+ 



C v = Nk 



eT - 1 



eT - 1 



(56) 



(57) 
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N harmonic oscillators: heat capacity 
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N harmonic oscillators: heat capacity 



As usual, we look at the low temperature and high temperature 
limits. From equation (57): 



Cy = Nk 



¥) 2 



eT 



eT - 1 



We see that: 



and: 



C v ^0 as T^O (T<0) ; 



C v ^ Nk as T^oo (T>6>). 



(58) 



(59) 
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N harmonic oscillators: entropy 



Finally, we look at the entropy. As in the case of the spin-i 
solid, we obtain the entropy from the expression for the 
Helmholtz free energy, F: 

'dF\ 



S = - 



Vary 



v 



We use: 

F = -NkT\n(Z), 
and the expression (46) for the partition function: 



(60) 



(61) 



Z = 



e_ 

e 2T 

1 - e t 



Following the same procedure as for the spin-^ solid, we find: 



S = Nk 



e/r 



eT - 1 



In 1 - e t 



(62) 
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N harmonic oscillators: entropy 
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N harmonic oscillators: entropy 



From expression (62) for the entropy: 



S = Nk 



e/T 



eT-1 



In 1 - e t 



we can derive the low temperature limit: 

S^O as T^O (T<0). 
and the high temperature limit: 



S ^ Nk 



1 + In 



(63) 



(64) 



as T^oo (T»0). (65) 
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N harmonic oscillators: quantum and classical limits 



The range of temperatures for which T « 0, may be regarded 
as dividing the quantum regime (T <c 0) from the classical 
regime (T > 0). 

At high temperatures, the average energy per oscillator is kT, 
and this is much larger than the gap between energy levels: the 
range of allowed energies may be regarded as essentially 
continuous. 

At low temperatures, kT becomes close to k0{= hw): when this 
happens, we can no longer ignore the fact that the allowed 
energies for an oscillator occur at discrete intervals. 
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N harmonic oscillators: quantum and classical limits 



In the quantum limit, T —> 0, the energy, heat capacity and 
entropy behave as follows: 

U -> ^Nk0, (66) 
C v - 0, (67) 
S -> 0. (68) 

There is a "zero-point" energy of \k0(= \huS) per oscillator. 
The heat capacity and the entropy tend towards zero, as all the 
oscillators start to fall into the lowest possible energy state. 
This agrees with what we find for a real solid. 
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TV harmonic oscillators: quantum and classical limits 

In the classical limit, T —> oo, the energy, heat capacity and 
entropy behave as follows: 

U -> NkT, (69) 
C v -> ATfc, (70) 



S ^ Nk 



1 + In 

1 6 



(71) 



The energy and heat capacity behave as expected for a real 
solid (except that we have to replace N by 3N, to account for 
motion in three dimensions). 

The entropy is interesting: we notice that Planck's constant 
still appears, even in the classical limit. It seems that entropy is 
intrinsically a quantum effect. 
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TV harmonic oscillators: quantum and classical limits 

We should emphasise that the behaviour of the entropy in the 
classical limit that we find in this system does agree with the 
classical theory. According to the first law of (classical) 
thermodynamics: 

dU = TdS -pdV. (72) 

At constant volume: 

dU = TdS. (73) 
In the classical theory, C v = Nk is a constant, so we can write: 

U = C V T .-. dU = NkdT. (74) 

Hence: 

rS rT dT 

ls 0 dS = Nk k^ (75) 



and so 

S = Sn + Nk\n ( 

Jo 



S = S 0 + Nk\n (—) . (76) 
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N harmonic oscillators: quantum and classical limits 



Compare the expression for the entropy from classical 
thermodynamics, equation (76): 



with the expression from statistical mechanics (71), derived 
using a model of N quantum harmonic oscillators: 



In classical thermodynamics, there is no way to derive the 
values of the constants So and T 0 : put another way, it is 
impossible to find the value of the entropy of a system at 
absolute zero. Using statistical mechanics and quantum 
mechanics, there are no uncertainties: we have an expression 
involving known constants and quantities, that corresponds to 
the classical model in the high temperature regime. 
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N harmonic oscillators: quantum and classical limits 



The model of a solid that we have developed is known as the 
Einstein model. It gives the correct behaviour in the low 
temperature and high temperature limits. But in the 
intermediate regime, it fails to describe accurately the 
properties of real solids. 

The Debye model, in which the vibrational energy of the atoms 
is treated as a gas of "phonons" , gives a more accurate 
description of the behaviour of solids at low temperatures. 
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as T — > OO. 



N harmonic oscillators: quantum and classical limits 



i - 




T/T D 
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Summary 



You should be able to: 

• Explain how the partition function is calculated in a 
statistical system. 

• Explain how the partition function can be used to calculate 
the energy and entropy of a system as functions of 
temperature. 

• Calculate the populations; total energy; heat capacity; 
entropy; and magnetisation of a spin-^ solid, all as 
functions of temperature. 

• Calculate, as functions of temperature, the total energy; 
heat capacity; and entropy of a system consisting of many 
1-dimensional quantum harmonic oscillators. 
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